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We consider the problem of maximizing the expected utility of 
discounted dividend payments of an insurance company whose reserves 
are modeled as a Cramer risk process with Erlang claims. We focus 
on the exponential claims and power and logarithmic utility functions. 
Finally we also analyze asymptotic behaviour of the value function and 
identify the asymptotic optimal strategy. We also give the numerical 
procedure of finding considered value function. 

1 Introduction 

The problem of finding optimal dividend strategies for an insurance com- 
pany have been studied many times. A mathematical formalization of this 
problem was proposed by Gerber [3]. He assumed that the reserve process 
{Rt)t>o of an insurance company is a classical Cramer-Lundberg risk process 
given by 
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where Yi,Y2, . . . are i.i.d positive random variables representing the claims, 
= {Nt)t>o is an independent Poisson process with intensity A > modeling 
the times at which the claims occur, a; > denotes the initial surplus and 
H is a premium intensity. Additionally we will assume that generic claim 
Y has Erlang distribution Erlang(/c, i^) which is probably the most common 
distribution in actuarial science. 

Apart of the reserve process ([T]) we can consider the dividend payments. 
Let {Ct)t>o be an adapted and nondecreasing process representing all ac- 
cumulated dividend payments up to time t. Then the regulated process 
X = {Xt)t>o is given by: 

Xt = Rt- Ct. (2) 

We observe the regulated process Xt until the time of ruin: 

r = inf{t >0:Xt<0}. 

Obviously the time of the ruin of an insurance company depend on dividend 
strategy and after ruin occurs no dividends are paid. 

Following Hubalek and Schachermayer [5l| who considered the Brownian 
risk process with drift we assume that {Ct)t>o is absolutely continuous with 
respect to Lebesgue measure which means that for each t > 0: 

Ct = Cgds a.s. 
Jo 

and we define the target value function as 

v{x) = supE^ (^j^ e-'^^U{ct)d?j , 

where U is some fixed utility function and means expectation with re- 
spect of Px{-) = Pi-\Xo = x). We maximize the value function v{x) over 
all admissible dividend strategies {ct)t>o- We assume that dividend density 
process {ct)t>o is admissible, if it is a nonnegative, adapted process and there 
is no dividend after ruin occurs: Q = for all t > t. 

For above dividend problem we will prove the verification Theorem [T] 
producing the Hamilton-Jacobi-Bellman (HJB) equation for optimal value 
function. Like in many other cases the HJB equation cannot be solved ex- 
plicitly. Therefore we analyze the asymptotic values of the value function 
focusing on the exponential claim sizes and the power and logarithmic utility 
function (see Section [3]). 

In Section |4] we give new algorithm of identifying the value function. 
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2 Hamilton-Jacobi-Bellman equation 

From now on we will assume that U G C°°(]R>o) is concave such that 
U(0) =0 and the Inada conditions are satisfied i.e. \imU'(x) = oo and 

lim U'{x) = 0. We also assume that: 

x—^oo 

lim U{x) = oo. (3) 

X—^OD 

Then if we consider strategies approximating lump sum payment at the be- 
ginning (i.e. Q — )■ oo as t J, 0) condition ^ implies that also: 

lim v{x) = oo. (4) 



We will use the variational approach based on the verification theorem and 
Hamiltonian-Jacobi-Bellman equation. 



Theorem 1. The value function uniquely solves HJB equation: 

jfc /"OO 



Pv+sup \ (/i - c)v^ + 77:^^^ / [v{x -y)- v{x)]y''-^e-^ydy + f/(c) \ = 0. 

(5) 



Proof. If V is absolutely continuous then using classical arguments we know 
that V solves uniquely (|5| (see e.g. [S], Sec. 2.1]) which follows from that fact 
that infinitesimal generator of the risk process R has the following form: 

Af = /i/. + [fix -y)- f{x)]y'-'e-^ydy 

and V is in its domain; see e.g. [TJ p. 460]. 
For any x we can write 

.+ ^<.W<.+ ^. (6) 

The lower bound of v{x) is obtained by paying x out immediately and then 
to pay out the premia at rate /i until the first claim occurs. The upper bound 
comes from the pseudo strategy paying out x immediately and thereafter to 
pay out a dividend at rate /i, not stopping at ruin. Inequality above leads to 
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conclusion that v{x) is locally bounded. Considering for Xq = x + fih {h > 0) 
and for any strategy q the new strategy: 

~ _ ( t<h or T <h 
ct-h TAt>h 

one can derive two-sided bounds: 

v{x) > e-^^+^^%{x + fih) > e-^^+^^''v{x), 

where T is a moment when first claim arrives. By ^ it means that v is 
locally Lipschitz continuous and using [21 p. 164] one can conclude that 
V is absolutely continuous. Hence equation ^ holds true if one interpret 
as a right-derivative. The optimal strategy equals q = c*{Xt) for some 
measurable function c*. Obviously supremum in ([s]) is attained at 

c*{x) = {Ur\v^) (7) 

Putting ([t]) to equation ^ we obtain 

^iv,-c*v,-/3v + U{c*) + —^— / [v{x-y)-v{x)]y''-'e-^ydy = 0. (8) 



(k- 1)1 Jo 

Since v is continuous it follows that is well-defined. This completes the 
proof. □ 

The equation ([S]) can be rewritten as: 

fiv, - c*v, -{13 + X)v + U{c*) + r v{x - y)y'"'e-^'Jdy = 

(^-1)! Jo 

Integration by substitution leads to: 

f^v,-c*v,-W + X)v + U{c*) + j^^ viz){x-z)''-'e^'dz = (9) 

(^-1)! Jo 

From the equation above follows that v G C^(i?>o). If we differentiate this 
equation by x we get 

[K — ij\ Jq 

+ ^^(A;-1) r v{z){x-zf-^e^'dz = Q. (10) 

{K — ij! Jo 
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Then by calculating the integral from equation doj) and putting it back to 



the equation (10) we derive 



fJ-Vxx - clv^ - c*Vx^ - (/3 + \)v^ + Ux{c*) + ^{fiVcc - c*v^ -{I3 + X)v + U (c*)) 

\Ckp~^x px 

+ 7^^ / v{z){x-zf-^e^'dz = {). (11) 



If we repeat this procedure k — 1 times we will derive the following equation 
for the value function: 



i:C)e( 

1=0 ^ ' 



_ + A)w('-') - (c* !;,)('=-') + U^''-'\c*)) + Xi'^v = 0, 



where f'^''^ means By some simple calculation, changing the limits of 
summation and using the general Leibniz rule we can convert this equation 
into: 

k-l 



- E ( ■) «• E (* 7 ') - = 0. (12) 



This is nonlinear (A;+l)th order nonlinear differential equation. Let notice 
that from equality ^ it follows that for /c = 1 equation (12) simplifies to the 
following one: 

fiv^x + (e/i - /3 - \)vx - iPv - ev^^ - iev^ + et/(c*) = 0. (13) 

It is still difficult to solve above equations. Therefore we will analyze it 
asymptotically for large reserves x — ?■ oo and give numerical procedure of 
solving them. 



3 Asymptotic solution 

We start from asymptotic analysis and the following lemma. 
Lemma 2. lim Vx[x) = 0. 

x—^oo 



Proof. At the beginning we show that hm c{x) = oo. For the proof by 

contradiction let assume that there exist K > such that for all x > we 
have c(x) < K. Then 

v{x) = supE^, (^j^ e-'^'U{ct)d?j < (^j^ e-^'U{K)d?j 

< E,, (^^" e-^'U{K)d?j < < oo. 

This means that v{x) is bounded which is a contradiction with Q. Thus 
indeed c{x) — oo as x — t- oo. Then from equality ([T]) it follows that 



lim Vx{x) = lim U'{c*{x)) = 0, 

" ' " x—^oo 



where the last equality in this equation comes from Inada condition lim U'{x) 

x—^oo 

0, which we required from the utility function. □ 



From now on we will assume that claims have exponential distribution 
with parameter ^, that is Yi = Exp(^). 

3.1 Power utility function 

In this section we will consider the power utility function: 

U{x) = —, x>0, ae (0,1). (14) 

a 

Then the supremum in ([s]) is attained at 

c* = {Ur\vx) = vF^ (15) 



and the equation (13) simplifies to: 



1 — a 

f^Vxx + {^fi-P- X)vx - ^Pv + ^ vt" - v'x-'-Vxx = 0. (16) 

a 

This is nonlinear second order ODE. Obviously we need some initial condi- 
tions. Putting X = into equation (|9| we get: 

^'(0) = ^..(0) + ^l^fAo)^. (17) 
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By Riccati's substitution we transform this problem to nonlinear first order 
ODE. Let Vx{x) = y{y) then v^x = Uxiv) = y^Vx = VvV- Including this into 
equation (16) produces the following equation 

1 — Ci —a —a 

f^VvV 13- A)?/ - ^I3v + ^ - y^y^ = (18) 

a 

which is equivalent with 

(^^-(3-X)y-^(3v + e-^y^ 



(19) 



This is nonlinear first order ODE without known explicit solution. There- 
fore we will focus on its asymptotical behaviour producing also the asymp- 
totic optimal strategy q = c*{Xt) of paying dividends being the asymptot- 
ical function c*{x) depending on the present amount of reserves. We write 
f[x) ~ g{x) iff lim^.^oo f|fy = 1- 

Theorem 3. Let a = - G (0, 1), where p,q p < q. Then as x ^ oo, 

Q 

1 — a \ X 



(21) 

c*{x) —X. (22) 

1 — a 

Remark 4. Note that assumption that a is rational is not very restrictive 
because the set of rational numbers is sufficient in modelling all kind of shapes 
of the power utility function. 



P 

Proof. When a = - then equation (18) has the following form: 
Q 



q — p V p 

fJ'VvV + (^/^ - /3 - A)?/ - ^fiv + ^ yp-i - yp-iyv = 0. 

P 

1 -, _ 

If we make substitution z = j/^^', then = ^^yvzz'^ ^. Putting this into 

equation above we get: 



7 



If we multiple both sides of equation above by z'^ ^ we obtain 



P 



This is equation of the form 



(23) 



P{v,z) - z^Q{v,z) = 0, 



(24) 



where P, Q are polynomials in v and z. Any term of the left side of (24) is of 
one of the forms z"^am{v) or 2;t,z"a„(f). Vojislav Marie in [6] proved that if 
for two functions am, an E7i (where denote the class of Hardy functions) 



then the set of all terms of the left side of equation (24) is totally ordered 



with respect to the relation ^. Where a ^ b, for v ^ oo means that either 
I — !■ oo or I — )■ /(t^ 0) as f — )■ oo. Furthermore in [HI p. 195] it was proved 
that in this set exist two terms of the same order i.e. whose quotient tends 
to a finite limit / ^ for f — )■ oo. Using this we can derive asymptotic of 
solution of equation P{v, z) — ZyQ{v, z) = 0, for v ^ oo. 

Firstly, we have to notice that 2; — > oo since ?/ — ?■ for w — 00 and p < q. 
Because of that we note that in the equation (23 ) the element {q — p) fiz^ is of 
smaller order than the element yy. Similarly, the element {^IJ' — P — X)z'^~p~^^ 



has smaller order than other elements of the equation (23) which not contain 
y^. Because we know that there exist two of the terms of the equation (23) of 



the same order we have three possibilities which can produce the asymptotics 



of the solution v of the equation ( 16 ) 



b) and {p - q) z^z^] 



In the case a) both of these terms are of the same order. Hence 



which gives 



Z[V] ~ 



/3p 



l{q-p) 



1 

p 1 
VP . 
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I I 2q-p+l 

Putting above asymptotics into the equation (23) and dividing by f p 
gives / = 1. Finally we get the following asymptotics of z{v): 

z(v) ~ ( ^^V^^- (25) 
\q-pj 

Obviously in this case z ^ oo for — > oo as we required from z. 
Similarly, in the case b) we have: 

{p-q)z^z^ 
^ p 

L'Hopital rule guarantees that z has the same asymptotics as the solution a 
of the differential equation of separated variables: 

p 

which gives 

ziv) ~ {v + c)p-i. 

\ p J 

But for p — g < we have 2; — > as i; — t- oo which contradicts the assumption 
that z — )■ 00 for t> — )■ cxD. 
In the case c) we have: 

{q-p)z'iz^ 

which simplifies into considering the following equation: 

2p-o-l 
Z^ ^ Z„ 



q-p 

We will distinguish two cases. 
I. If q' 7^ 2p, then 



1 , „ , 1 
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II. If g = 2p, then 

z{v) ~ e p V 2 



Note that in the case I the asymptotics of z have sense only if g < 2p because 
otherwise z — for f — )■ oo and we get again the contradiction. After 



substitution above asymptotics into the equation (23) the increment coming 



from ^^-y-z'^'^ ^"'"^ dominates any other increment. Dividing both sides of the 



equation (23) by this asymptotically "largest" element leads to false identity 
1 = 0. 



Summarizing, the asymptotic solution of z is given by (25). We made 
substitution y = z^~'^ and the asymptotics of y{v) is given by: 



P-Q 

P p-q 



f3p 

y[v) ~ \ J V V 



l-a 



1 — a\ " -(l-g) 



which is equivalent with: 



y^v) - 1 ^ ) V 
Recall that y{y) = Vx{x). Using L'Hopital rule and solving equation: 

l-ct 



give (20). This completes the proof by (15). □ 



3.2 Asymptotic solution of the HJB equation for log- 
arithmic utility function 

In this section we will consider the logarithmic utility function: 

U{x) = ln(a; + 1), x > 0. (26) 
Then supremum in the equation ^ is attained for: 

c* = {Ur\vx) = --l (27) 
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and the equation (13) simphfies to: 



(/i + l)v,, + (e/i + e - /3 - - ^Pv -^Inv,- -V,, - ^ = 0. (28) 

This is a nonhnear second order ODE. By the Riccati's substitution Vx{x) = 
y{v) we can transform this problem into the nonlinear first order ODE: 

(e/i + e - /3 - A)y - e In y - - e + (/i + i)yyv -yv = o (29) 

Theorem 5. As x oo we have, 

v{x) ~ ^ (ln(/3(x + 1)) - 1) ; (30) 

c*(x) ~ + - 1. (32) 

Proof. We will use similar arguments like in the proof of Theorem [3j In fact, 
one can derive the same expression like (24) with this difference that now in 
P and Q expressions of the form f ™ In v and will appear. What is im- 
portant that both these expressions will appear there (to satisfy eliminating 
procedure giving \6^^ Eq. (3.3)]). Then mimic all arguments of [6] one can 
conclude that also in the case of the logarithmic utility function there exist 
two of the terms of the equation (29) of the same order. 

Note now that in the equation (29) the increment {^ + l)yyv is of smaller 
order than i/y. Similarly, the increment {^n + ^ — /3 — X)y is of smaller order 
than all other elements which not contain y^. We have then three possibilities: 

a) y^ and ^f3v + 

b) y., and ^\ny; 

c) ^Pv + ^ and ^\ny. 
In the case a): 



which gives 



yiv) ~ m- + liv + c. 
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When f — i- oo then y — )■ ±00 and we get contradiction since by Lemma [2] 
?/ — )■ when t> — )■ 00. 
In the case b): 



lim — 



0), 



and by L'Hopital rule f ~ a for a satisfying 

1 n J^^^ _ Ija + C 
y Jo y ' 



(33) 



Then the right side of equation (|33|) goes to ±00 depending on value of / 

lim 



when f — )■ 00. The left side of this equation goes to lim = and we get 



contradiction. 

In the case c) we have 



which gives: 



hm — = /(^ 0), 



y[v) ~ e i - 



(34) 

Asymptotics above has sense only if Z < 0, because otherwise y 00 when 



V ^ 00. Putting the asymptotics (34|) into (|29|) gives / = —1. Hence: 

y{v) r 



-I3v~l 



Recall that y{v) = Vx{x). Thus f ~ a with a solving: 



This gives 



t;(x)~^(ln(/3(x + C))-l). 



Deriving (31) and (32) is straightforward. 



□ 



4 Numerical analysis for exponentially dis- 
tributed claims 

In this section we give numerical algorithm of finding the value function 



for exponentially distributed claims and the power utility function (14). To 



do this we will find Vx{0), then (based on the boundary condition (17)) find 



f (0) and numerically solve the equation (16). 
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Remark 6. The choice of Vx{0) is crucial in the context of optimahty of 
solution of HJB equation. Indeed, if we choose Vx{0) too big (see Figure [T|, 
then v(x) and Vx{x) go to infinity as a; — )■ cxo. In fact, by (15) the discounted 



cumulative dividends goes to (see Table [T]). This situation corresponds 
to a bubble, i.e. value of the company is not materialized by the dividend 
pajmients and we can not discuss the optimal solution. 



v(.v) 





(a) Function v{x) 



(b) Function Vx{x) 



Figure 1: Functions v{x) and Vx{x) for a = 0.5, /3 = 0.05, fj, = 0.26, ^ = 0.4, 
A = 0.1 and v^iO) = 2, v{0) = 6.8. 



When Vx{0) is sufficiently large like Figure [2] shows, then the function 
v{x) is concave and Vx{x) tends to as x — >• cxo allowing the cumulative 
discounted dividend payments to increase (see Table [2]). 
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X 


v{x) 




c{x) 





6,8000 


2,0000 


0,2500 


1 


9,4022 


3,1941 


0,0980 


2 


13,3275 


4,7502 


0,0443 


3 


19,1343 


7,0039 


0,0204 


4 


27,6771 


10,2878 


0,0094 


5 


40,2103 


15,0801 


0,0044 


6 


58,5692 


22,0787 


0,0021 


7 


85,4378 


32,3029 


0,0010 


8 


124,7394 


47,2425 


0,0004 


9 


182,2094 


69,0750 


0,0002 


10 


266,2320 


100,9833 


0,0001 



Table 1: Functions v{x) and Vx{x) for a = 0.5, (3 = 0.05, fi = 0.26, ^ = 0.4, 
A = 0.1 and w^(0) = 2, v{0) = 6.8. 




2 4 6 8 10 2 4 6 S iO 

X X 



(a) Function v(x) (b) Function Vx{x) 

Figure 2: Functions v{x) and v.j.{x) for a = 0.5, (3 = 0.05, fj, = 0.26, ^ = 0.4, 
A = 0.1 and w^(0) = 1.9, v{0) = 6.8021. 
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X 


v{x) 




c{x) 





6,8021 


1,9000 


0,2770 


1 


8,5790 


1,6929 


0,3489 


2 


10,2022 


1,5575 


0,4122 


3 


11,7010 


1,4431 


0,4802 


4 


13.0940 


1,3454 


0.5525 


5 


11.3963 


1.2613 


0.6286 


6 


15.6203 


1,1884 


0,7081 


7 


16,7762 


1,1247 


0,7905 


8 


17,8723 


1,0687 


0,8755 


9 


18,9158 


1,0192 


0,9626 


10 


19,9126 


0,9752 


1,0515 



Tabic 2: Functions v{x) and Vx{x) for a = 0.5, /3 = 0.05, jj, = 0.26, ^ = 0.4, 
A = 0.1 and w^(0) = 1.9, v{0) = 6.8021. 
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To find Vx{0) we propose the following algorithm. 
• Calculate initial value Vx{0) =: b, 



From the equality (17) derive initial value v{0) =: a; 



Solve numerically the differential equation (16) with the initial condi- 
tion v{0) =: a; 



Calculate c(x) using c(x) = V3;{x 



-1 



Using the least squares method match to c{x) with the linear function 

c(x) = aix + bi, 

Let x(t) be a trajectory of the regulated process starting from until 
the first claim arrival T. Hence 

H-c{x{t)) =x'{t), x(0)=0, (35) 

xit) = /i^ - ^e--*; 
Oi ai 

Using the least squares method match to v{x) the function of the form 

v{x) = a2X°' + 62; 



Calculate 

(36) 



r 

A = E [e"^^{)(x(5) -T)]+E / e-^^?7(c(x(5))rfs 



where S = Exp(A), T = Exp(^). 

• Calculate value a — A; 

• Repeat until |a — A| < e for fixed e > 0. 

If we choose Vx{0) hence also v{0) = a correctly then observing the reg- 
ulated process just right after the first jump occurs the left hand side A of 
(36) gives true estimator of f (0). Hence A will approximate a. In practice we 
should look for "correct" a changing Vx{0) by some small fixed value d > 
until |a — y4| < e for the prescribed precision e. 

We applied above procedure with ten points least square algorithm to the 
data given below the Figure [2j The results are described in the Figures [3} |4] 
and the Table HI 
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2 4 6 3 10 

X 

Numerical dividends ■ ■ ■ ■ Dividends from LSM 



(a) Functions c{x) and c{x) 

Figure 3: Functions c(x), c(x) and 
H = 0.26, ^ = 0.4, A = 0.1 and v-^{0) 




t 



(b) Trajectory x{t) 

trajectory x{t) for a = 0.5, (3 = 0.05, 
= 1.9, v{0) = 6.8021. 




Figure 4: Functions v{x) and v{x) for a = 0.5, (3 = 0.05, fi = 0.26, C, = 0.4, 
A = 0.1 and v^{0) = 1.9, v{0) = 6.8021. 
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b 


a 


A 


a- A 


1,9 


6,802105263 


6,794392618 


0,007712645 


1,89 


6,803336861 


6,796662198 


0,006674663 


1,882 


6,804464186 


6,798652236 


0,005811950 


1,8819 


6,804479085 


6,798679195 


0,005799890 


1,88186 


6,804485051 


6,798690050 


0,005795001 


1,881851 


6,804486392 


6,798692504 


0,005793888 


1,8818504 


6,804486482 


6,798692667 


0,005793815 


1,88185035 


6,804486489 


6,798692681 


0,005793808 



Table 3: The values of initial conditions obtained from procedure of finding 



18 



References 



[1] R. Bellman (1953) Stability theory of Differential Equations, McGraw- 
Hill, New York. 

[2] J.L. Doob (2004) Measure theory, Springer, New York. 

[3] H. U. Gerber (1979) Introduction to Mathematical Risk Theory, Richard 
D Irwin. 

[4] G. H. Hardy (1912) Some results concerning the behaviour at infinity 

of a real and continuous solution of an algebraic differential equation of 
the first order, Proc. London Math. Soc. (2) 10, 451-468. 

[5] F. Hubalek, W. Schachermayer (2004) Optimizing expected utility of div- 
idend payments for a Brownian risk process and a peculiar nonlinear 
ODE, Insurance: Mathematics and Economics 34, 193-225. 

[6] V. Marie (1972) Asymptotic behavior of solutions of nonlinear differen- 
tial equation of the first order. Journal of Mathematical Analysis and 
Applications 38(1), 187-192. 

[7] T. Rolski, H. Schmidh, V. Schmidt, J. Teugles (1999) Stochastic pro- 
cesses for insurance and finance, John Wiley and Sons, Inc., New York. 

[8] H. Schmidli (2008) Stochastic Control in Insurance, Springer Verlag. 



19 



